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Abstract 

It was proved by Michel Talagrand in [TO] that the Parisi formula for the free energy in the Sherrington- 
Kirkpatrick model is differentiable with respect to inverse temperature parameter. We present a simpler 
proof of this result by using approximate solutions in the Parisi formula and give one example of appli- 
cation of the differentiability to prove non self-averaging of the overlap outside of the replica symmetric 
region. 
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1.1 Introduction and main results. 

> 

^--j- ■ Let us consider a p-spin Sherrington-Kirkpatrick Hamiltonian 

: 1 
12 : H Nj ,(tr) = (p _ 1)/2 • a - ■ ■ ■ g ^ 

, . , l<h,...,i p <N 

G\ 

indexed by spin configurations a £ S^r = {— 1, +1} where (9i lt ...,i p ) are i.i.d. standard Gaussian random 
variables. A mixed p-spin Hamiltonian is defined as the sum 



H N (a) = J2Pp H r*, P (<7) ( L1 ) 

p>i 



H ' over a finite set of indices p > 1. The covariance of Hn can be easily computed 

EHN^Hnitr 2 ) = N^R h2 ), (1.2) 

where 

R ^ = ^J2 a i a i and ^)=£/^ p - 

i<N p>l 

A quantity is called the overlap of configurations cr 1 ,^ 2 . To avoid the trivial case when all the spins 
decouple we assume that j3 p ^ for at least one p > 2 so that £"(x) > for x > 0. Given an external field 
parameter h £ K, the free energy is defined by 

F N (P) = ±-ElogJ2eTq>(H N (*) + hJ2ai). (1.3) 

<t i<N 

The problem of computing the thermodynamic limit of the free energy limjy^oo Fn is one of the central 
questions in the analysis of the SK model and the value of this limit was predicted by Giorgio Parisi in [5] 
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as a part of his celebrated theory that goes far beyond the computation of the free energy. The prediction 
of Parisi was confirmed with mathematical rigor by Michel Talagrand in [TT] following a breakthrough of 
Francesco Guerra in [2] where a replica symmetry breaking interpolation was introduced. Validity of the 
Parisi formula provides a lot of information about the model and, in particular, about the distribution of the 
overlap under the Gibbs measure corresponding to the Hamiltonian Hn(ct). In the next section we will show 
one important application of the Parisi formula which is based on its differentiability with respect to inverse 
temperature parameters. Namely, we will prove a stronger version of the result of Pastur and Shcherbina in 
[6] about the non self-averaging of the overlap at low temperature. 

In the remainder of this section we present a simplified version of the argument of Talagrand in [lOj and 
prove the differentiability of the Parisi formula. Let us start by recalling the definition of the Parisi formula. 
Let M. be the set of cumulative distribution functions on [0, 1]. We will identify a c.d.f. m with a distribution 
it defines and simply call m itself a distribution on [0, 1]. A distribution with at most k atoms is defined by 

m {l) = ^2 mil(qi <q< qi+i) (1.4) 
o<;<fe 

for some sequences 

= mo < mi < . . . < m,fc_i < rrik = 1, 
= go < qi < ■ ■ ■ < qk < qu+i = 1. 
Consider independent Gaussian r.v. (z/)o</<fc such that Ezf = C{qi+i) ~ Let 



X k = logch( ^ zi + h 



and recursively for 1 < I < k define 



0<l<k 



Xi--l = — logE/expm^ (1.5) 
mi 



where E; denotes the expectation in (z p ) for I < p < k. Define 

V(m,P)=EX -~ m l {e{q l+1 )-e{qi)). (1.6) 

l<l<k 

where 8(x) = x£'(x) — £(x). On the set of discrete m S M. as in (|1.4|) the functional V(m, (3) is Lipschitz in m 
with respect to L\ norm (see [2], [H3])- Therefore, it can be extended by continuity to a Lipschitz functional 
on the entire space M.. The Parisi formula is then defined by 

V(f3) = inf V{m,(3). (1.7) 

This infimum is obviously achieved by continuity and compactness. Any m € M. that achieves the infimum is 
called a Parisi measure. It is conjectured (|4|) that V{m.,f$) is convex in m in which case the Parisi measure 
would be unique. 

By Holder's inequality, Fn((3) is convex in /3 and, thus, its limit P((3) is also convex. Convexity implies 
that V(f3) is differentiable in each parameter j3 p almost everywhere and it was proved in [115] that V(J3) is in 
fact differentiable for all values of f3 p . The proof was based on a careful analysis of the functional r P(m,f3) 
in the neighborhood of a Parisi measure and parts of the proof were rather technical due to the fact that a 
Parisi measure is not necessarily discrete. We will prove a slightly weaker analogue of Theorem 1.2 in [10] but 
we will bypass these difficulties by working with approximations of a Parisi measure by discrete measures of 
the type (II. 4[) . The main difference is that we express the derivative in (|1.8p below in terms of some Parisi 
measure instead of any Parisi measure as in [10] . 

Theorem 1 The derivative of the Parisi formula V(j$) with respect to any (3 P exists and 

dV{(3) 



d(3 p 

for some Parisi measure mp. 



fiJl- I q p dmp{q)\ for all p>l (1.8) 
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To prove Theorem [T] we will first obtain a similar statement for discrete approximations of a Parisi 
measure; this result corresponds to Proposition 3.2 in [10] . 



Lemma 1 Given k > 1, suppose that m £ M achieves the minimum ofP(m,/3) over all distributions with 
at most k atoms as in Then 



dV 
W P 

Proof. Suppose that m has k 1 atoms in (0, 1) for some kl < k. For simplicity of notations, let us assume 
that k' — k. Let us start by noting that EXq depends on (3 only through £'(1) and f° r I < I < k. Let 

us make the dependence on £'(1) explicit. Since 



X fc _ 1= logch( *l + h) + l(ti'(l)-e(qk)) 



0<i<fc-l 

we can continue recursive construction (11.51) to show that 



for some smooth function f(x\, . . . , xt) : R — *■ R. Then, rearranging the terms in (|1.6[) 

V(m, 0) = \ £(1) + \ • • • , C («*)) + \ E - m i-i)°M- (1-9) 



2 

KKk 



Since m achieves the minimum, for 1 < I < k 



oqi oxi 



and since > f° r 9 > this implies that 

Of 



Since 



~(mi - mi_i)qi. (1-10) 
oxi 



£(<?)= E^V, £'(<?) ^E^^" 1 and ^^E^-^V, 



using (|1.9p and (jl . 10[) we compute 

go- = Pp+ E X! (wi-^i-OCp-l^gf 

^ p KKfe ! KKk 



l<l<k 

and this finishes the proof. 

□ 

Proof of Theorem [TJ First of all, let us fix all but one parameter in (3 and think of all the functions 
that depend on (3 as functions of one variable (3 = f3 p . Let m k be a distribution from Lemma [T] By definition 
of Parisi formula and Lipschitz property of V(m, (3) we have V(m k , /?) J. "P(/3) as k — > oo or, in other words, 

0<V(m k ,/3)-T{f3) <e k (1.11) 
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for some sequence e k | 0. To prove that a convex function V{0) is differentiable we need to show that its 
subdifferential dV{j3) contains a unique point. Let a € &P{f$). Then by convexity of V, (jl.lip and the fact 
that V(P') < V(m k ,/3') for all /?', 

V(f3 + y)-T((3) V(m k ,f3 + y)-V(m k ,f3)+e k 
a < < 



and 



ci> V(j3)-'P(P-y) > V(m k ,(3)-V(m k ,f3-y)-e k 



y y 

for y > 0. It is a simple exercise to check that for any discrete m£A< the second derivative <9 2, P(m,/?)/<9/3 2 
stays bounded if j3 stays bounded and the bound is uniform in m (see [TT] or [10]). Therefore, using Taylor's 
expansion around y = on the right hand side of the above inequalities gives 

?E-{m k ^)-Ly- £ -± <a< ^( m k , (3) + Ly + ^ . 
dp y d(3 y 

Taking y — ^fe^ we obtain 

a=^(m fc ,/3)+0(V^)=/?(l- J q p dm k {q)) + O(^) 

by Lemma [TJ Finally, taking a subsequence of (m k ) that converges in L\ norm to some Parisi measure mp 
proves that 



a = p(l- J q p d m/3 (q) 
This uniquely determines a and, thus, a = V '(/?)• 



1.2 Non self-averaging of the overlap. 

In this section we make an assumption that all indices in (jl.ip are even numbers with one possible exception 
of p = 1, i.e. besides a trivial linear term we consider only even spin interaction terms. The reason for this 
is because the validity of the Parisi formula was proved in [11] under certain conditions on the function £ 
which essentially correspond to the choice of only even spin interaction terms. Under this assumption, by 

ELI], 

lim F N ((3)=V((3) 

N—>oo 

and since both Fn{(3) and V(/3) are convex functions and, by Theorem [TJ V(f3) is differentiable in f3 p , we 
get 

nr\ <>v / r 

p dmp(q) 



n^oo df3 p df3 p y \ J 



N 

By Gaussian integration by parts one can easily see that, 

dF N 



da 



p (l-E(Rl 2 ) 



where (•) is the Gibbs average with respect to the Hamiltonian Hm{(t) and, therefore, for any p > 1 such 
that P p > we get 



lim E(R P 12 )= / q p dm p {q). (1.12) 

N—rOO ' J 

Thus, from Theorem [JJ one obtains information about moments of the overlap, in particular, about the exis- 
tence of their thermodynamic limit. (This result is not new, it appears in [S] and [TD].) If Hamiltonian Hn(<t) 
contains all even p-spin interaction terms then (|1.12[) holds for all even p > 2 and, thus, the distribution of 
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I -fill 2 1 is approximated by the Parisi measure mp. It is predicted by the Parisi theory that this is also true 
when only a finite number of even p-spin interaction terms are present; however, this is an open problem. 
(|1.12|) provides information only about the moments of the overlap corresponding to the terms present in 
the Hamiltonian. 

We will now use this information to give two examples of non self-averaging of the overlap. To put these 
examples in perspective, let us first recall several well-known results about the classical 2-spin SK model, 
Hn = /3-Hjv,2i without external field, h = 0. Let us recall that inverse temperature parameter f3 is said to 
belong to replica symmetric region if the infimum in the Parisi formula (jl.7p is achieved on Dirac measure 
5q concentrated at zero. In this simplest case the Parisi formula V(f3) is called a replica symmetric solution. 
It was proved by Aizenman, Lebowitz and Ruelle in [1] that replica symmetric solution holds for f3 2 < 2 and 
it was proved by Toninelli in [12] that it does not hold for (3 2 > 2 (the result in [12] is more general, it also 
covers the case with external field). In other words, the set of f} 2 < 2 is the replica symmetric region. Note 
that the reason we have (3 2 < 2 instead of a more familiar 1 < 1 is because for simplicity we defined the 
Hamiltonian iijv,2 as the sum over all indices %\ and rather than i\ < i%. A well-known result of Pastur 
and Shchcrbina in [6] states that if 

lim E({Ri 2 ) - E(#i 2 )) 2 = (1.13) 

N—>oo 1 

then replica symmetric solution holds. Therefore, for (3 2 > 2 (|1.13[) can not hold and this implies that 
limsupjv^oQ E(i?f 2 ) > 0- Differentiability of the Parisi formula implies that the limit lini/v-»oo E(R 2 2 ) in 
(|1.12p exists and, consequently, the result of Pastur and Shcherbina can be used to deduce that this limit is 
strictly positive when 1 > 2. However, one can give a more direct proof of a more general result without 
invoking [6]. 

Example 1 (h = 0,/3i = 0). This case is similar to the classical SK model without external field, only 
now p-spin interactions for even p > 2 are also allowed. A replica symmetric region is again defined as the 
set of parameters (3 such that the infimum in (jTTTJ) is achieved on Dirac measure So concentrated at zero, but 
the description of this region is slightly more complicated (see Theorem 2.11.16 in [8 ). Using the continuity 
of the functional m — > V(m,(3) with respect to the L\ norm (see [2], [10]), outside of the replica symmetric 
region any Parisi measure mp must satisfy mp({q > 0}) > 0. Therefore, by (I1.12|) . for any even p > 2 such 
that j3 p > we have 

lim E(R[ <2 ) > 0. (1.14) 

Since by symmetry, (R1.2) — 0, this proves non self-averaging of the overlap outside of the replica symmetric 
region. 

Example 2 (h 7^ 0, /3 Pl ,/3 P2 7^ for some p\ < p2)- A similar argument can be used in the presence 
of external field if at least two different even p-spin interaction terms are present. In this case, due to the 
absence of symmetry, a replica symmetric region is defined as the set of parameters (3 such that the infimum 
in (|1.7p is achieved on Dirac measure 8 X concentrated at any point x S [0, 1] rather than zero. Again, by 
continuity of m — ► V(m, j3), on the complement of the replica symmetric region any Parisi measure mp must 
satisfy 

J \q - x\dmp{q) > £ 

for all x G [0, 1] and some e > 0. This means that mp is not concentrated near any one point x £ [0, 1] and, 
therefore, 

( J q^dmp(q)f /Pl < U q^dm^q)) 1 ^ - 6 
for some S > 0. By ()1.12j) . for large enough N, 

(E(i?r 2 )) lM < (E(R^ 2 )) 1/P2 S - 
which means that the Gibbs measure can not concentrate near one point and, therefore, 

E((fli,2-E(fli, 2 )) 2 > > 5' > 0. (1.15) 
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□ 

Even though these examples strengthen and generalize the result of Pastur and Shcherbina in [BJ, 
unfortunately, the argument used above does not apply to the most interesting case of the classical 2-spin 
model with external field, fa 7^ 0, h ^ 0, and it is not clear how to prove (|1.15[) in that case. 
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